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SUMMARY 



Objective 

The purpose was to develop and leal an objective procedure to determine the relative difficulty of \ir Forte 
jobs. Also investigated were (a) the measurement of task difficulty to allow e omparahility across specialties. (I)) the 
quantitative appraisal of job demands based on i oiupoiietit tasks being performed, and (e ) the e omparahility of job 
difficulty to job aptitude requirement. 

Background 

The present work is the c ulmuiatioii of a long stream of research and development examining im tljbdologies 
for systematically determining relative aptitude requirements of Air l one jobs. Sin li methodologies an needed 
since there are no empirically baaed procedures for establishing, adjusting, or verifying tin aptitude < utoil More 
requirements published in Air Force Regulations. 

Karlv research in this area offered substantial support for the use of time-lo-learn as a key element in 
measuring the ability requirements of Air Forte jobs. In addition, the level of aptitude required tor successful 
performance of a task was found to be i otic eptually inseparable from the time required to learn to perform the task 
at a satisfactory level. Thus, a hem hmark staling tec hnique. in which am hor tasks are used to de>c ribe eat h level 
on the scale, was developed to measure rcLtive difficulty from vvllich relative aptitude requirements could he 
inferred. 1 hese results may he used by Vir Force managers to establish entry-level aptitc.de requirements ami to 
assign individuals to Career specialities more accurately. 

# ■* 

Approach 

The stmK was based on task-level specifications of learning difficulty. Ylie specifications were provided by 
two complementary sources >f expert ratings. One source included occupational survey data, that i> routinely 
collet ted on most vir Fore e jobs. Sue St data contain iciaiive i.ttiiip of ui->k dillu .;!'> tone * U d frutii knowh dge able 
supeniMirv personnel within each specialty. Secondly, contract job analysts provided benchmark ratmg> of 
selected tasks acioss specialties. Collection ol benchmark d..ta permitted the development of techniques lor 
calibrating the siiperv isors' ratings to a standard referent e base sue h that tasks in one spec ialty c mild be c ompared 
to 'asks in other spet laities. Data on tin relative time spent by job im umbeiits on ca« h task aUo were available in 
the occupational survey data. These data were used to weight the relative diffic ulty of eat h task when computing 
aggregate estimates of learning difficulty for each enlisted specialty. 

Specifies 

I he(.omprehens,ve Occupational Data \na!ysis Program> (CODAP) package was used for the analysis of task 
level data, Interratcr reliability ami correlation te c Imiques wen- used to assess the agreement among supervisor* 
and job analvsts in the ratings of task diffic ulty, Regression equation*, were used to calibrate relative ratings on the 
benchmark scale. The calibrated ratings then were* combined with average* time-spent data to determine the 
relative* difficulty of individual jobs and specialty groups. The resultant values were designated VTDIH 
(average* task difficulty per iinij time spent). 

Boil) supervisory ratings and the e oiitract job analyst ratings proved to be highly reliable In addition, a high 
degree of relationship was sliown between the supervisory ratings and the contract job analyst ratings The 
benchmark scales provided a highly reliable means of obtaining task diffcuity ratings that we ie comparable a< n»s. 
specialties. 

Conclusious/Heeommendations * 

The methodology developed and nnplenientcd can be applied objectively to evaluate the relative aptitude* 
requirements of Air Force jobs. Air Force managers now have systematic and empirical data with which to orde$ 
-jobs relauve to each other based on the level of talent required. It is ree ommemlcd that this methodology be 
considered for Use in operational realignment of current aptitude requirements. 



PREPACK 



The purpose of tlii^ research effort was to develop and appl> a methouologv for the evaluation of 
aptitude requirements for Air Force enlisted specialties based ta»k difficult). ThLs effort was the initial 
phaj>e of a project in response to RPR 73-17. Minimum Aptitude Requirement for Airmen \FSCs. to derive 
empiricallv-hased minimum aptitude requirements for Air Force enlisted specialties. The researc h is in 
support of the Force Acquisition and Distribution S>stem subihnisl. and Manpower and Force Management 
thrust. 

Dr. Ravmond E. Christal of the Air Force Human Resources Laboratory (AFHRI.) deserves specific 
credit for the evolution of this research from an original concept for determining aptitude requirements u> 
the development of a complex methodolog) which allows assessment of the learning difficult) of each 
individual job in the Air Force. He is due special recognition for working \er> closely and conscieiiliousl) 
with the authors throughout the period of this report. Acknowledgement is also due Mr. Fred Hart. kintou. 
Inc.. Alexandria. V A. for leading a vcrv large and complex data collection effort and to Mrs Nam > Perrigo of 
VFIIRL for laying the earl) groundwork for the project. Special appreciation goes to the \ir Force Manpower 
and Personnel Center Directorate of Personnel Resources and Distribution (AFMPC/MPCR). I tili/ation 
Policy and Control Division (AFMPC/MPCRP). and t'SAF Classification Branch ( \FMPC/ X !PCRPCP) for 
their longstanding support of this pioject under RPR 73-17. Email), this project could not have been 
slice essfullv completed without tin expert programming and seeminglv continuous consultation of Mr 
Johnnv tyeissinuller of AFHRL 
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APTITUDE REQUIREMENTS BASED ON TASK DIFFICULTY: 
METHODOLOGY FOR EVALUATION 



I. INTRODUCTION 



Eligibility for entry into the Various Air Force career ladders is based primarily on the minimum aptitude 
,core cutoff on one or more of the composites of the Armed Services Vocational Aptitude Battery (ASVAB) (AFR 
39-1, 1977). There are four ASVAB composites in use by the Air Force: Mechanical, Administrative, General, 
Electronics. An individual's percentile score on these composites is the principal factor for determining eligibility 
for entry level jobs. Although this repon is primarily a description of methodology and procedure for the 
evaluation of aptitude requirements, the essential problem being examined is the validity of the relative ordering 
of assigned ASVAB iiiiiiiiiuuus in comparison with the computed relative order of difficulty of the jobs based on 
work performed. 

The correlation of success in training with aptitude composite scores and the technical school pass/ fail rates 
are the primary data used by the Air Force to set aptitude niininiuius. Relative correspondence between success in 
training and each of the aptitude composite.* is used to establi »h the aptitude area (M, A, G, or E) for a specific 
specialty, and the pass/fail rate is used to adjust the minimum cutoff score (Maginnis, Uchinia, & Smith, 1975a, 
1975b, 1975c). Although this appears to be a valid and empirically based decision logic, there exist some deep- 
seated problems. The standards for successful completion of courses appear to be arbitrarily set and tend to 
fluctuate with the number of trainees needed. This problem is further compounded by a training time and aptitude 
trade-off. That is, an unsuccessful trainee, rather than being washed-out, may be recycled through the same course 
until a passing score is achieved. Thus, a potential failure has been converted to a successful completion by 
allowing more time to learn. Christal (1976) presents a detailed description of the problems in the prediction of 
training success from aptitude test scores. 

The consequences of setting appropriate aptitude levels for entry into Air Force specialties (AFSs) go beyond 
the immediate impact on training outcomes. For example, lowering a requirement from the 80th to the 60th 
percentile could dc::b!e the number of eligible volunteer* for a particular occupation (Christal, 1974). 
Inappropriate assignment of aptitude requirements can ha\e n significant impact on job attitudes-individuals 
assigned to jobs that do not fully utilize their talents tend to experience boredom; individuals assigned to positions 
requiring more talent than they have tend to experience a sense of frustration (Locke, 1976). Both circumstances 
can adversely affect absenteeism, retention, and learning rate (Briyfield & Crockett, 1955; Taylor & Weiss, 1972: 
Waters & Roach. 1971, 1973: Wyatt, Langdon, & Stock, 1937). The data collected in this study go beyond the 
training school setting and reflect the actual difficulty of a given job in the operational setting. 

The overall objective of the present effort was to design, develop, and test a methodology that could be applied 
effectively and objectively to determine the relative difficulty of Air Force jobs. The two major sub-objectives were 
to develop procedures for (a) the measurement of task difficulty such that tasks would be comparable across 
specialties and (b) the quantitative appraisal of job demands based on component tasks being performed. 



II, APPROACH 

Conceptual Framework 



Empirical data are not necessary to realize that there is tremendous variance both in job demand levels and in 
individual learning rates. It is not difficult to imagine some AFSs in which those airmen with the lowest aptitude 
(the slowest learners) can perform very successfully after only a short training period. On the other hand, there are 
also AFSs in which the airmen with the highest aptitude (the fastest learners) must undergo extensive on-the-job 
training even after long periods (30 or more weeks) of formal training. The need to determine the relationship 
between aptitude and learning time has become more acute as has the necessity of defending empirically the 
aptitude levels that are set as occupation entry requirements. 

beveral educational researchers offer support for the use of time-to-learn as a key element in measuring the 
ability requirements of Air Force jobs. Aptitude can be looked at as something that re nits in an individual being 
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ready to learn r*ipidl\ in a speTiTTTsitiialiou (Cronbach & Snow, 19*77). furthermore. Crouku li ami Snow e laini 
that students will likely differ in the time they require to learn, given the same material and iiistruc (ional 
pren ednres. Recent dot turn illation In Gettinger ami White (1979) offers additional evidence in support of time -to- 
learn as a predictor of at hieveinent ami aptitude. These authors indicate that the liine-lo-learu uiihi i>t makes no 
assumptions about the intelligent e required to perform a task, hut deals only with per for ma me under natural 
(onditioiis. This literature in addition to earlier work by Carroll (in Blot k X \udersou. 1975. in Croubac h X .Snow. 
1977. and in Krumholt/.. 1965) provides strong support for the integration of the time-lo-learn eoiue pt into tin Air 
Force classification and assignment systems. 

The Air Forte Human Resources Laboratory (AFHRL) has been conducting research into this problem for 
several years. The methodology discussed in this report has greatly benefited anil evolved from previous work 
conducted by Cbristal (1970 and Ftigill (197,1, 1972a. 1972b. 1973) in developing the Air Force job inventor) 
methodology and investigating tin area of task difficulty and benchmark scale use. The approach was based on 
task level specifications of learning diffitulty provided by two omp!. mcntary sources of e xpert ratings, (a) 
knowledgeable superv isorv .personnel within each spec ialtv provided relative; ratings of task difficulty, and (b) 
contract job analysts provided benchmark ratings of selected tasks across specialties. Access to the hem limaik 
ratings permitted |he development of technique:* for calibrating the relative ratings to a standard reference base 
and foi generating aggregate estimates of learning difficulty for every enljsted specialty in the Air force. 

«• 

Task Difficulty 

The concept of task difficult) was operational!) defined in terms of the lime it takes to learn to do a task 
satisfactorily. Ftigill (1971) demonstrated that in spite of the complexity of the concept, highly reliable ratings of 
relative task diffic ulty. as defined above, could be obtained from supervisor) job inc tiuiheiits from a given can't r 
field. Fugill's (1972b) research consistently demonstrated a high relationship (r - .89) belwec u *ime -to-h arn (task 
diffic ulty) and (ask aptitude, "the level of aptitude* required to insure satisfac tor) .perforinaiic e of a given task" (p. 
l). The aptitude requirements research documented in this report has proceeded on the basis that the 1 aptitude 
lervel required to learn a job can be inferred from a measurement of the aVerag* difficult) of that job. This 
assumption i*» primarily ha*edon Fugill"** (1972b) t one lu^ion that relative ta^k aptitude ^conceptually inseparable 
from relative task diffic ultv when difficulty is measured in terms of the time needed to learn to perform a ta^k 
satisfactorily. 

Occupational Survey Data Base 

The basic data used in the identification of tasks for the estimation of (ask/job difficulty indite** cauie from 
the oc e upational survey data routinely collected by the I SAF Oe c upational Measurement Center, briefly, the job 
inventories used in the periodic occupational surveys of Air Force jobs jr. deve loped hy c rcaling a duty outline 
and a listing of task statements based on job de se riptioiis, c ourse training standards, and other puhlUhc d materials 
(Cbristal. 197 0. Tasks are them organized within duly categoric- and the task list revised based mi work-site 
observation of the job and input from let liuical spec ialists. When ftuali/.cd. tin job inventory is adiiiiuislc redtojed) 
incumbents within the specialty to collect information about (be relative amount of work-lime spent on the tasks 
which they perform, using a 1-9 point scale ranging from "A Wry Small Vmouiit" to "A Wry Large Amount." 
These data are compiled a computer-generated job description to provide, among other information, an 
estimation of the percentage of nu .imbeiits who perform each task and the average pent ntagc of time spc ut on 
each task hy those in the specialty who perform it. This same information can be reported for any group of 
individuals who can be de fined by available bat kgrountlv ariables sue h as time in m rvice. grade, education, and 
time; in job. 

t 

I he same duly/task list is administered to supervisors who are asked to rale tin tasks on task difficulty, based 
on how mm h lime is required to learn the task, using a I -9 point scale ranging from "A Wry .Small Vuuninl * to *' \ 
Very Large Amount." These ratings are compiled to give an estimate of the task diff*» ulty of each task compared 
with other tasks in the inventory -* 
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Analytic Techniques 

Thr(.oiii|irel«-iiM\e()<<iipalioiial Data VuaUsis Program.* (CODA!*) package developed b) U'HRL (CJiri*lal. 
I<>74; MorsJi. Madden. K Uinstal. I%D »a> the data anal) lie tool used for this research. Tin- COD VP s\slem was 
ideall) Milled for llu> l\pc of auaKsis. Computer anal)sis of all rating data began wild die lueaMiremciil of the 
degree of uilrrraler agreement among alL ratrr>. computed using die iiitra-class correlation coefficient (Ujj) 
described b\ Haggard (I ( )3H) and Lindqiii.*! (1953). This reliabilit) coefficient is a measure of the iulcrclas< 
eorrrlatiou among raters. As discussed in Gnilfoid and Kmc liter (I ( )73). eac h coefficient (K 1 1 ) - taken to be an 
indication of the reliability of a single rater's, ratings. ( an be used to infer tin- reliabilil) of a group of rater* (Rj^) 
(p. 2(A). B\ averaging each set of ratings across the number of raters rating each task, group reliabilit) coefficients 
(R k |.) for all measures can be computed.' The inlerraler reliabilit) (oefficieiit as applied to task factor rating* i? 
described b) Good) (l<)7(>) and Thomson and Good) 0<)7<)). In addition. correlation/regression technique*, the 
calculation of average ta>k rating.- ac to>> raters, and the ge neration of adjusted lask A diffie nil) value* ba>ed on the 
benchmark equations were used in the specific aual\«cs for task ratings. The anal} lit technique are farther 
discussed in the description of procedure* to develop task and job difficult) indices. 

III. DETERMINATION OF TASK DIFFICULTY 
Development of Benchmark Scales 

Ratings of task difficult) within specialties, as routine!) obtained in conjunction with occupational Mine)*, 
are useful in comparing tlie relative difficult) for tasks and jobs within career ladder.-. However, a method wa- 
needed for comparing difficult) and aptitude le\els for tasks across career ladders. 

The use of benchmark scales pro\ ides ver\ reliable ratings of task difficult) which allow for comparison* of 
the relative difficult) of tasks not oul\ within a gi\en special!) but also ac rosa an) uuiuber of *pec ialtio measured 
b\ the same benchmark si ale. The bent hinark sc ale is used as a standard referetic c for calibrating rating* obtained 
within specialties so as to be comparable across all specialties in an aptitude area. The fea^ibilil) of u*ing 
benchmark scales to measure task difficult) was demonstrated h\ Fugill (l ( )7l. I<)72a. I°72h) and further 
discussed b\ l ugill ( 1973) and Uiristal (l«)71). Peters and McCormick (!%(>). in a comparati\e >tnd). obtained 
results which demonstrated that task-anchored (bene hinark) scale- resulted in more reliable rating- of >eve ,1 job 
factors than did numerically anchored scales. 

Considerable thought was gi\eii to the number of points to be emploved on tlie hem hinark M ale Lissit/ and 
Uccn (I<)75) briefl) reviewed the literature in tbis area and found (inconclusive evidence to >npport an) specific 
number of rating points. Research on lime-speiil scales b\ Carpenter. (Borgia, and McFarlaud ( 1^75) >nggesl< that 
there is little difference in reliabilit) but a potential increase in v.dielil) witb an increase in the number of rating 
options from 7 to <) to 25 and e\eii to 100 points. These results in conjiine lion with researeb b\ ChrMal and Madden 
UMotl) and Madden (l%0. I%l) on tlie importance of familiaril) in e\aluati\e judgments in job evaluation 
directed this research to a 25-poiut benchmark scale on which the rater would be carefull) trainee*, on both the 
tasks anchoring the scale and the tasks to be rated, prior to applying the scab-. 

Electronics, Mechanical, and General/Administrative Benchmark Scales 

Ta^k difficult) benebmark stales were developed separate!) for the Elee Ironic s. Mechanical, and General/ 
Vdmiiustrative aptitude are^s as differentiated bv the ASVAB. l or a given aptitude are a, a m t of 13 *p*-c tallies was 
seleclc-d whicb best represented aptitude area complex*!) and provided a varic tv of tasks from wlmb beinhmark 
tasks could be se letted. All specialties Usee! in (be deve lupine hi of tin benchmark seale-s ale shown In Appendix A. 

Fable I provides JU siuumar) of inlerraler reliabilit) statisties for the relative difficult) ratings collected from 
specialties use-d in the benchmark scale development. I siug a distribution of these ratings and the e rileria oulliiied 
in Table 2. 40 tasks were selected from eae h specialt) to develop a set of 600 bene hmark tasks in the Mechanical 
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an<l Kh'< Ironic * aptitudr an\i>. For tlir general hriuhmark ><ah\ ()() ta>k> wrrr >rlr<t, d from rji h of thr 1.1 
hjm'i tallica* to produce a 4 )00-U*k li>t, lor piirjH>M> of dix u»iou. oiil) lltr 600-ld.«k li*N will Ik rrf« r< utrd although 
r»rntiall\ thr >jiii< prut rdurr* wrre followed with llir ( )00 la*k* in thr (U ueral Item hiuark pool. (S< « VpjM udix \ 
for complete iutcrratcr reliability MaliMio.) 
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Table 2. Benchmark Task Selection Criteria 

1. Klimiuale Mipcr\M>n ta*k> 

2. (iaplurc range of difficult) 

Select on high ralriuigrrciueul (Low SI)) 

>. Select la*k* performed b\ fir^-tcrmer* 

.1. Select well known t;i*k* 

(). Select ea*d) ol>*er\ed Ki*k* 

7. N'lert on high fare \alitlih 



\ panel of H to II job anal}M> wa> convened for rat h aptitude area. Tin* panels, whuh rousted of contract 
personnel roiiMilrrril expert in the aptitude area, obtained detailed ta>k le\rl information from Inimical m IiooI 
iiiMnn tor> and jol) mi iliuhruta*. and obsrrxd ta>k performaiu e at approximate!* 10 operational loc ation- for each 
aptitude area. After pamiiifr familiarit) with eat h task in the list. < a» li panel member pr.nidcd an independent 
rank-orderly of tin- 000 ta>k>. pla» nig thr task which required thr least learning time at iiiimhrr I and thr ta-k 
requiring thr greatest lr irmii^ timr at iiiimhrr 000. Thr final ranking represent thr rrlati\r ordering of thr 000 
tasks on thr dimension of learning lime, without regard to M\S. Intrrratrr reliability estimate for the r;mk 
ordrriiipamoiipjiidpr- for ra« h apliludr arra arr »\\vii in Tahh- 3. In ail. for thr thrrr aptttmlr arra-. 2,MHI ta-ks 
wrrr imh*prii(lrnll\ rank-ordrrrd l>) j tram of « to It ratrr-, rcMillitip in approximatrl) 21.000 raiiL-ordrr 
r.sliiiiati*^. 

Table X. Intrrratrr llrliahilit y (K kk ) for Kaiik Onlrring of 
Aptitudr Arra Bmchiuark Tusks 
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The ranking procedure used was one in which the judges made pair-wise comparisons of tasks on which the) 
were foundered expert. This procedure reMilted in a rank-ordered list of tasks whit li. it was felt, mare accurately 
captured the variance of the difficult) of the tasks than would a 9-poiut rating system. However, the resulting 
distribution was understandably rectangular in shape and thus did not lend itself to the development of a 
benchmark Male with equal intervals. The solution to this problem was based on the collection of <)- point 
supervisory ratings of the 600 .selected tasks. These relative ratings were collected from approximate!) 50 
supervisors from each of the If) specialties who rated even task in the list, not just those selected from their 
...penalty. The resulting distribution from these ratings appioximated a normal curve. \n equal percentile 
conversion program in theCiODAP package was used to convert the task distribution preserving the order from tie 
ranking procedure into the normal distribution obtained from the rating procedure. This converted distribution 
was used to develop a clo.se approximation of an equal-interval benchmark scale. L ' 

Based on the panel ranking* and the siiperv isory rating* of the 000 bent hiiiark tasks, two ta>k> were selected 
to represent eat h of the learning diffic ulty levels of a 2r>-poiut scab . The distribution of the mean rank of the 600 
tasks was cli\ ided into 27) equal intervals. Tasks were selec ted which were close to eat h interval midpoint value and 
for which the standard deviations of both the within-spec ialty ratings and the contractor rankings were relatively 
low. indicating that both sets of judges agreed on the diffit ultv level. Tasks were chosen whic h were widely known 
or frequently performed, ami not unique to a single specialty. The final criterion, face validity, was especially 
important in the task selection process inasmuch as these tasks were to be used as examples that woalcl am hor the 
various points on the benchmark scales. (See Appendix B for complete benchmark scales.) 

Procedural Guides 

\i curate application of the bene lunark stales requires detailed knowledge of the hem hmark tasks ,1s well as 
the tasks being rated. A procedural guide was developed for eat h scale describing the hem lunark tasks This guide 
was developed for the use of the panel of expert raters who would apply the scales. 

There are two parts to the procedural guides. Part I introduces each panel member to the task of assessing 
learning diff unity and rating the tasks. Pari II presents the 2r>-poiut scale and provides a one-page description of 
each of the .">() tasks on the scale. This description includes the scaled task difficulty level, the task title, the 
specialty from which it was selected, a narrative description of any specific equipment associated with the task, a 
narrative describing the task performance, and an explanation of the skills and knowledge required to learn the 
task. Kxamplcs from the Mechanical Procedural Guide are included in Vppeudix (!. 

Task Hating Using the Benchmark Scales 

, The benchmark scales and procedural guides were developed to provide task ratings which were comparable 
both within and across specialties within an aptitude area. In order to obtain such information, it was necessary to 
apply the same benchmark *cale to all specialties in an aptitude area. This was accomplished by comparing a 
carefnllv selected subset of tasks from each specialty to be assessed with the tasks on the appropriate benchmark 
scale and assigning the respective rating to each task in the subset. Regression techniques were then used to 
estimate the difficulty of the remaining tasks in the job inventory from the data available from the subset of tasks. 

I sing criteria similar to those used in the selection of the benchmark sets (Table 2). 60 tasks weie selected 
from each remaining specialty in the aptitude area for evaluation by the contract job analysts using the benchmark 
scales, bpeeialties used in the application of the benchmark scales are indicated in Vppeudix \. In the application 
phase, 102 specialties were evaluated, approximately 31 technical school and 64 operational site visits were made, 
and approximately 6.100 tasks were rated by 12 to 14 raters, resulting in over 79.000 ratings. Again, each task 
selected was studied in depth at the appropriate technical school, as well as at two or more operational work sites, 
bv a panel of aptitude area experts. Panels consisted of 12 to 14 members, with two independent teams of six or 
seven analysts observing the same tasks at separate locations. After accumulating considerable information about 
' each task, the panel members independently provided benchmark difficulty ratings on the 60 selected tasks from 
each specialty using the appropriate benchmark scale. Interrater reliability statistics for these ratings are 
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eMinmarized in Table 4. Compleje rater reliabilitv statistics on I hi- tasks for all specialties studied are p\vt\ in 
Appendix A. • 

TuUlv k Summary of Benehmark Haling Iiilerratrr Keliabilitv (R^) 
Indices for Specialties I'sed in Application Phase 



\,.lil«dr" . B-V-of Median N N„ «r 



CtMiera!/ \clmiiiMralivr .ft? - M M ~m 1 10 

Mechanical «8 - .98 ^ ^ 



Electronics .°2 * .W 



.<)o 22 * 12 7* 



Calibration of Supervisor) Kstiinates to the BeMchmark Scale 

The benchmark rating of the sample of 60 tasks withi.i rai h >pe< ialiv were used to esiiuiate tin relative ta-k 
<iiffieull) of all tasks in a >pe«ialt\ iisjng standard regression aual\»is. The ux of I lit- ben< miiark s <a les allows a 

task difficult) vJue to b tim.ited for even task in the invenlorv for the US under < ulceration. This value in 

,U<ru, provides the means b\ whnli tasks and indiv idual jobs i an l»' lompaicd not oii!\ in relation to other ta-k- 
and jobs- within (he same special!), but aUo relative to lask> in other spei ialties within the same aptitude area \ 
separate regression equation was used for eat h \FS. as the relationship between 'lie expert rating and relative 
rating was unupie for each special!) . 

The hem hmark dilfn ultv rating and the supervisor) dif fit ultv rating of the same (>() tasks were input .is ihe 
dependent and independent variables, respectively . m a two-variable linear regression problem lor eai h sp n laltv 
The equation took the following form: 

(V - a + b\) 

••here V i» a»lj •»»•«•'! i ;i~V. difficult* 
a i- a constant 
I) i» a regression coeflicient 

\ i.- a com piolte »uper\isor\ rating ol relative task dillicullv 

The resulting equations were then applied to lite »uper\ »or\ rating ol all U.sks in the qMciullic* ami an adpi-led 

difficult) rajmg «.h c> aled lor each task. In all. adjusted dtllu ultv rating were climated lor approximate!* 

7.>.(KMI tasks 

Suiiiuiart Result* of Task Difficult) Assessment 

The reliability and vahditt of the data gathered hi this rflorl « mvol.gatcd '«> ">*"re that overall 

(hodolug* wa> mhiimI. ^"flle rater rchjhilil) cocflic.cn.s (K„) for all meagre* ranged li > lu 71 l-roiip 

rehalnhlN eoell.c.enN (R. . ) for all measures ranged fro... .«(, to M. (.See Appendix \ for complete rcll.lblhl* 
MalMieO l>reliniu.an .iiv-sltgati. n ha* shown that the range ol reliabilit) estimates is largcl) determined I.) the 

Infill variabilis ol la.sk learning d.ffi.ulu a< r Iiffcrciico in aircraft, equipment, or c mamk additional 

research .s ciirreilll) being condncted to determine the reasons for instances of low inlcrraler agrcoilioill « 

\s shoMll i.l Table •"). correl; l.s between the beiiclllliaik .alings In the tv.o ...dependent lcam» ol rale.s 

raoged fr ..Ml to <M with a median ol .7'). Invcstigati, f the range ol these lean, l-leain 2 correla Ilirthci 

cmpha*,/ .e great .leal of variabilis in the individual ta.sk difficult) level,. In .he .pecialtio for winch the 

.ii'erteam correlation* were low. there evidence that conflicting information was gathered fr, opera .al 

s.t.-s due to ditlerem n equipment, automation of jobs, or mission requirements. Tl vlt) of tile work area 

( . N| „. r ,s toll Inferences „ provides addi al credibilil) to the data co Hon procedure 
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Tahlr *. Summarv of Correlations between Tonus I and Team 2 Ratings 
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I wdem i of i dim urn nl v al ulil v of lhr dala t olli i It d n*iu« lhr la-k difi »« nil \ Im in Iiiu.ii k >-i ale- i- pi ov ided b\ 
i on i I.ilnui- 1m Ivvi i ii lite .mi.i^f \\ilhiu--pt i iallv lalin^- i olii t led iroiu uu umheol -upt i v i-ni- .mil I lie average 
Im in luuark raluitr- i ollei l< d Iroiu .tplilmle ,ni-.i t\pnl-. \- «houu in Table (». iht i oi relation- Id luccii the^e 
\ c* r t .1 ian»»i (I I roiu .."i I lo .01 willi .i iiii'Ji.i.i of .80 loi .ill -pt < i.illie- -Unhed in I lie ihrrt .iplilmh .iie.i.- (\ - 
I 1 7) Tin -t n lalion-lu,p- id ft r -upporl lor I In il.il.i t ollt i lion nit ! hodnlot£v and I In Im in Siiii.ii k .-i aim*; pi oi rdure. 
I lo < Mill an i mi ii .id * 1 1 ia l I In il if fit nil v pn tin lion- from Im to lnii.uk d.il.i ,i |»r< nl a no ,iMin of I In dii I i< uitv of 
a la-k \\ lin 1 1 1 .in Im t oiupait d ti< i <— will a- vv illnii -pi i lalhe- m l hi -ami «t | »l il it<!t a ana. ( .on i pit It i or i id.ition.il 
-lali-lii-. -unini.iri/ed in Table* .*> .Hid 0. an* included in \ppendi\ \ 

Table (k Siniiiuar\ of Correlations between Witlim-Specinlt\ Ratings 
and Benchmark Ratings 
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( nov rr-ioii id la-k dii I H ultv mlo |oh diftu nil v vva- ton ml lo hi nioii i mnpln aled than a -nupli av t ra^t ol (lie 
dii I ii nil n-- ol l In- ta-k- » ompi i*i n j: I In* job. \ job < an br dif In till lor a v arul\ oi ri'.i-oii- *m h a- on in her oi la-ks. 
loinlilioiio under ulm h I lit la^k- an perforim d. varn'U ot l.i-k-. ditto nil \ of ta-k-. and tin anionnl ol tnni •penl 
on iln* v a non- l.i-k- prrlornn d. i'ln v.irii U of la-k- and 1 1 it i in ironinrnl.il < out I ii ion - ol pri Im mam i did nol lend 
ihrin-elvi"* lo tjiianl il it aliou Tin nninlier of i.i-k> prrlormed a- a iin aMin ol joh dilfnulu Imiiid lo he 
Miiiieuli.il im-li'ading. t -petiallv in louipan-ou- of joh- toulaiuni^ \v\\ \vr\ diitunli ta-k- v\illi joh- i oiitaiiuilg 
Mia n \ -iniplt* la-k- Joh dii in ulu u.h delirmiuttl lo hr hr-i t -huialt tl a- a fl ti lit lion of llu thllit nil % ot the l.i>k- 
eoiiipri-ing llie joh and llie linir -penl on lho-r la-ks. 



\verage Task l)iffieull\ Per I nil Time - ATDPl I 

The lotleitmii ami anal\-i- of la-k tliflnulh data have hi en dr-t nln tl prrvion-lv, Tiinr--peiil data for 
rainioiulv -i lei led joh im nmheiiN in .ill \ir I on e s»pei i.illn - ha- heen imihiit \\ * olln It d and anal v /ed hv the \ir 
I on e Oi i iipainmal Me.i-nremeiil (.ruler for llie pa-l -i veral year-. Tin -i data an iiiaiiil.nm d in a i ompntei dala 
hank .nnl were made availahle (or llu- -lud\ . In t tdlei hujr I In -r dala. job im uinhi nU arr rripiin d lo identif) llio^e 
la- k- vvhn 1 1 i oiupn-e hi- or her jtdi anil ihrii uidu air. ii-iuj: n lalivi linn -pi nl rating-, llo n lali vt I one ,-peiil on 

M 1 1: 



each task performed compared to all other tasks, performed (Carpenter, Ciorgia, & M< Farland. I ( )7f>). The data 
from diese ratings are analv/.cd v\itli the CODAP pat Wage. The relative time-spent ratings provided In the job 
incumbents are summed and the rating for eat h task performed is divided l>\ the mini of all ratings, thus 
computing a percentage time-spent variable. Previous rescan li has indicated Hut the relative time-spent format 
results in highl) reliable self-estimates of the percentage of time spent on the various tasks performed in a worker's 
]ol> (Christal. 1974). 

Job difficult) for an individual position was estimated ! mibiuiug the predicted task difficult) values, 
determined fioin the previous anal)ses. with tin* percent time - r < nt estimates to form a new computed variable. 
Average Task Diffic ultj Per I nit Time (ATI)Pl T). ATDPIT is simpl v the < ro..s-m*odiH t of pen eutage time-spent 
and task difficult) summed across all tasks in the inventor) for an individual job." ATDPIT can be computed for 
ail) group of individuals (e.g., specialt) members with I to t8 months of service) bv .summing cac li individual^ 
ATDPIT value and dividing bv the miiuber of individuals in the group. The CODAP pa A a go can he used to 
compute ATDPl T values for an) spec ified ^roup. I sing the ATDPl'T value, the diffic nil) level of iudiv idual jobs 
or job tvpes can be compared to an) other within the same aptitude area based on the relative time spent and 
difficulty of each task. 

The relative ranking of specialties from rich aptitude area on the ATDPIT value indicates the relative 
difficult level of specialties within the Air Force. Figure I shows a sample of specialties from the General/ 
Administrative aptitude areas ranked on ATDPIT value for enlisted personnel with I to t8 months of mililar) 
service and their c urrent AS\ AB cutoff scores. A comparison of the relative rankings of the ATDPl'T values with 
the ordering of the AM \B i utoff scores indicates a degree of misalignment of aptitude recpii rem cuts. Spec ificall) . 
Figure I suggests that some specialties c urrentlv assigned a high minimum aptitude requirement ma), in fact, 
have a lower level of difficult) than other specialties assigned a lower minimum aptitude requirement. Other 
specialties were found to cover a wide range of diffic ultv levels (iuclic ated bv the length of the horizontal lines in 
Figure I), suggesting that the specialt) might be divided into several different jobs. 



" \TIHM T value- an- multiplied l»\ 1 00 to eliimiuie <ir< imaU and. lime. Minplifv r. poring 
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Figure 1. Relative aptitude requirements for entry level jobs-.- 



" v \\ DISCUSSION 

I'he methodologv developed ami implemented in this r**>«*dr* li tan effee tiveh ami objeelivelv be applied to 
evaluate the relative aptitude requireuic;iit.s of Air Fejre* job* in a jiartie ular aptitude area. Re *ult» have hern 
Obtained te> substantiate both (In reliability ami tin' valielitv of this methoclolog). Tin* methodologv ha* been 
applied to Vir Forte job* a< ros* four aptitude- area*. The actual realignment of aptitude requirement* i* a complc \ 
ta*k whic \\ \s\\\ In* reported in a fortluoiiiiug report, however, in thi* methodology tin Air Tone now ha* a v aluable 
tool for maiiagemc nt and < la*iifu atioii. for the fir*t time, manager* have *>)*teiuatic . empirical data with w hit h to 
order job* relative 'o eat h otln r based on the le\el of talent required. Manager* now ha\e the iiitan* to eh tt riuine 
empirically the relative h \el of tliff'n ultv associated with new I) developed job* prior to .setting an aptitude More 
mi ii tut 11 in . The availability of the mean* by winch these dee i»ioii* can be made iia* far-reac hiug implic atioiia for 
the \ir Foree manpower and personnel coiiiiiiuni'y. 

The iiiiph< atioii* of the pre*ent study for the Air Forte e Ia**ific atioii system are parti< ularly relevant. The Air 
Force e urrentl). » la**if:e* a majority of enlistee* at the Armed Forte* Examining and Entrance Station* \ia a 
Person-Job- Match (PJM) algorithm (Hemlrix. Ward. Piua. & Mane}. 19?)). The PJM system determine!, .w hit h 
spec ialt\ to offer eae h potential applh ant. ithin thi* algorithm, then i* a job diffic nit) -aptitude iuterac tion term 
whnh increase* the likelihood of an offer of a specialty when there i* high similarity between job diffic ulty le\el 
and airmail aptitude le\el. In other words, the system will offer the 1110M diffitidt jobs to the mo*t talented 
app1i< ant*. The algorithm i**eiisiti\e to small differene e». For example . at the time of thi* researe h there were o\er 
Mi Kleitroim* VF.S requiring a iiiiniiiiiiin composite ore at the 80th tentile. In thi* instance, the PJM algorithm 
would likely offer the*e jobs more e veiily to all airmen se orhig at or above E-80 on the Elet troiiie * e ompo*ite of the 
AS\ \B. HoweYerfshoiilc] the VTDPIT* from thi* re*eart h be used in plaee of the ASVAB tutoff store in the job 
diffuult\ component of tin interaction term, the system would likely offer the more diffic tilt job* to those airmen 
>< ormg near ( )f> and the lea*t diffi* ult of the*e E-80 jobs to tho*e se oring m ar 80. thus providing a more effe< live 
distribution of available talent at ro*s job*. Sue I. a *y*lem would not. override current ASVAB minimum*, hut it 
would make more efficient distribution of available talent at or above the minimum. 

'I he implementation of these data into the PJM algorithm e ould a< leially re*ult in performing the same 
fiuittioii a* a change of aptitude iiiiiiiiiium*. Tor examph . it i* likelv that *ouie AFSs with e urgent aptitude 
minimum* of W are nearly as diffn ult a* other AFS* hav iug minimum* at the 00th u ntile. Without e hanging the 
mimiiMiiiis. an augmented PJM algorithm would tend to offer the more demanding job to individual* having a 
higher level of talent. 

The data from this projee t also provide Air Fone planner* with valuable information for the development of 
toiitmgeitiv plans for manning the forte in the fate of tab ut and manpower shortage*. Sime the abolishment of 
the draft, it ha* become increasingly diffn ult for the Air Fone to meet personnel procurement objective*. One of 
the few^ remaining alternative* for maintaining the fon e level may be to red in e aptitude level* fgr some jobs It is 
important lo determine how thi* might h< attomplished *o a* to have the smallest impac t on mi**ioii t apahilitie*. 
There are at lea*l three ways job and task diffieulty information touhl lie used in preparing sin h contingency 
plans, (a) determine where aptitude requirement levels <ould be redmed for existing specialties, (b) identify 
exiling job lv pes within AFS* whu h < ould be formed into new management i ategoric * and manned by individuals 
with le** talent, and (t ) ideutifv low-demand ta*k* in existing job* that touhl be formed into new jobs to be 
performed bv individual* with less talent (Christy L 1974). 

Research in tin* area is continuing. Currently planned effort* iuc lude a preliminary study of tin 1 extent to 
whnh the three benchmark stale* overlap and studies of the impact that thange* in the aptitude entry 
requirement* would have on the personnel acquisition and training systems. It i* anticipated that significant 
change* in aptitude entry requirements will be required. It is further antit ipatt d that the*e changes, when 
implemented, will have profound effec I* on the numbers of re-e ruit* eligible for different career fields, whirl; in 
turn will have significant impact on the training system. These- studies an designed to furthc r explore and refine 
the teehuology developed in thi* effort. 
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VI, CONCLUSIONS AND RECOMMENDATIONS 



It concluded thai the- metliodolog) for using job difficult) indict and time-spent data a- the Imm* for 
determining the relative aptitude level of an Air Force job is technically feasible. This niclhodolog) aUo provides a 
workable ostein for altering aptitude minimum* in the face of fluctuations in the atailabilii; of manpower 
resources with the least impact on mission capabilities. Since the utiliu of this metliodolog) . when umc! in the 
initial classification process, would insure a more effective distribution of available talent aero- jobs, it is 
recommended that this metliodolog) be considered for use in operational realignment of aptitude requirements. 
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Table Al. Specialties Used in the Development and Application of the Mechanical Benchmark Scal§ 



Incumbent 
Rat ings 



Benchmark 
Ratings 



AFS a 



Title 



R ll R kk R U R kk 



Incumbent 
vs . 
Benchmark 
Rat ings 



Benchmark Ratings 
Team 1 

vs . 
Team 2 



113X0 
114X0 
325X1 
361X0 
361X1 
362X2 
362X4 
391X0A 
423X1 
423X2 
-423X3 
423X4 
423X5 
426X1 
426X2 
427X1 
427X3 
427X4 
427X5 
431X0C 
431X1C 
461X0 

462X0 
464X0 
472X0 
472X2 



Flight Engineer Spec 

Aircraft Loadmaster 

Avionic Instru Sys Spec 

Cable & Antenna Sys Instal/Maint Spec 

Cable Splicing Instl & Maint Repair Spec 

Elec Switching Sys Repair Spec 

Telephone Equip Installer 

Maintenance Analysis Spec 

Aircraft Environmental Systems Mechanic 

Aircrew Egress Sys Mechanic 

Aircraft Fuel Sys Mechanic 

Aircraft Pneudraulic Systems Mechanic 

Aerosp Ground Equipment Mechanic 

Recp Propulsion Mechanic 

Jet Engine Mechanic 

Corrosion Control Spec 

Fabrication & Parachute Spec 

Metals Processing Spec 

Airframe Repair Spec 

Helicopter Mechanic (Articulated Rotor) 
Tactical Aircraft Maint Spec 
Munitions Systems Spec 
Aircraft Armament Systems Spec 
EOD Spec 

Base Vehicle Equipment Mechanic 
General Purpose Vehicle Maint Mechanic 



40 


95 


60 


95 


oi 


QA 
74 


44 


97 




9H 


01 


k 
V 


26 


93 


64 


95 


74 


oU 


29 


93 


51 


94 


-in 


D 


39 


94 


61 


96 


Q A 
00 


Al 

O 1 


35 


94 


76 


95 


ft 7 
O / 


ft? 

O £. 


37 


93 


66 


97 


o4 


7ft 
/ 0 


2 j 


Q /. 


/. /■ 


y\J 


1U 

1 H 


86 


31 


95 


47 


91 


ob 


Q 1 

7 1 


19 


94 


r / 

54 


94 


77 


u 


35 


y j 


63 


y o 


7Q 


b 


31 


96 


57 


95 


58 


74 


34 


97 


50 


93 


87 


75 


35 


95 


55 


95 


64 


68 


26 


94 


69 


97 


74 


b 


17 


90 


59 


95 


81 


b 


24 


94 


54 


94 


81 


b 


24 


93 


62 


95 


61 


74 


30 


95 


41 


89 


80 


82 


31 


97 


79 


98 


91 


b 


39 


97 


60 


95 


81 


b 


32 


96 


45 


92 


69 


69 


31 


94 


63 


96 


85 


93 


28 


96 


49 


93 


63 


b 


40 


97 


54 


94 


79 


72 


40 


97 


53 


94 


85 


77 
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Table Al (continued) 



AFS a 



Title 



Incumbent 
Rat ings 



Benchmark 
Ratings 



R ll R kk R ll R kk 



Incumbent 

Benchmark 
Ratings 



Benchmark Ratings 
Team 1 
vs. 
Team 2 



472X3 


Vehicle Body Mechanic 


40 


97 


64 


96 


81 


89 


542X0 


Electric ian 


39 


97 


82 


95 


, 80 


89 


542X2 


Electrical Power Production Spec 


39 


96 


65 


96 


87 


b 


545X0 


Re frig & Air Conditioning Spec 


28 


93 


60 


95 


82 


83 


546X0 


Liquid Fuel Sye Maint Spec 


37 


96 


67 


97 


85 


b 


551X0 


Pavements Maintenance Spec 


34 


97 


57 


95 


73 


b 


551X1 


Construction Equipment Operator 


34 


97 


53 


94 


82 


b 


552X0 


Carpentry Spec 


18 


93 


49 


93 


76 


b 


552X1 


- Masonry Spec 


33 


95 


47 


91 


74 


92 


552X4 


Protective Coating Spec 


41 , 


95 


49 


92 


88 


91 


552X5 


,.Plumbing Spec 


28 


97 


55 


94 


57 


b 


566X1 


Environmental Support Spec 


33 


94 


55 


94 


76 


b 


603X0 


Vehicle Operator/Dispatcher 


37 


96 


36 


87 


83 


86 


605X1 


Air Cargo Spec 


27 


86 


38 


88 


71 


87 



Note . Decimals have been omitted. 

a For the purpose of this report, not all changes in AFSs as shown in AFR 39-1 since the beginning of 
this project are reflected in this chart. However, seven AFSs have been deleted from this table due to 
changes in career field necessitating their reassessment. 

^Team L^and Team 2 analyses not conducted on these specialties. 
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Table A2. Specialties Used in the Development and Application of the 

Electronic Benchmark Scale 



Incumbent Benchmark Ratings 

V8» Team 1 

Incumbent Benchmark Benchmark vs. 

Ratings Ratings Ratings Team 2 

AFS a Title &11 &kk R U R kk r r 



302X0 Weather Equipment Spec 

303X2 AC&W Spec 

303X3 Auto Tracking Radar Spec 

304X0 Radio Relay Equipment Spec 

304X1 Nav Aid Equip Spec 

304X4 Ground Radio Comm Equip Repmn 

304X5 Television Equipment Repmn 

305X4 Electronics Computer Systems Spec 

306X2 Telecomm Systems/Equip Maint Spec 

316X0F Missile Systems Analyst Spec 

316X1L Missile Systems Maint Spec 

316X2G Missile Elec Equip Spec 

316X3 Instrumentation Mechanic 

321X1G Defensive Fire Control System 

Spec (B52D/F/G) 

321X2Q Weapon Control Systems Mechanic 

322X2B Avionic Sensor Systems Spec 

324X0 Precision Measuring Equip Spec 

325X0 Auto Fit Control Systems Spec 

325X1 Avionics Instrument Systems Spec 

326X0 Avionics Aerosp Ground Equip Spec 

326X4 Integrated Avionics Comp Spec 

328X0 Avionic Communications Spec 

328X3 Electronic Warfare Systems Spec 

341X1 Instrument Trainer Spec 

341X3 Analog Flight Sim Spec 

341X4 Digital Flight Sim Spec 

341X5 Analog Nav/Tac Tng Dvs Spec 

341X6 Digital Nav/Tac Tng Dvs Spec 



39 


96 


72 


95 


88 


b 


37 


95 


79 


97 


89 


b 


37 


95 


77 


96 


89 


b 


26 


96 


70 


91 


88 


b 


42 


97 


78 


98 


90 


o9 


34 


97 


73 


95 


78 


D 


37 


96 


75 


98 


87 


85 


31 


96 


72 


97 


89 


9U 


40 


98 


48 


93 


84 


68 


46 


94 


56 


97 


89 


D 


41 


95 


60 


95 


82 


O 1 

01 


34 


88 


73 


97 


88 


93 


38 


97 


69 


97 


96 


81 


41 


92 


76 


98 


89 


00 


32 


94 


59 


95 


54 


7^ 
/ 3 


33 


96 


56 


91 


66 


D 


43 


98 


62 


. 95 


76 


b 


41 


98 


75 


97 


87 


b 


26 


93 


55 


91 


71 


b 


37 


94 


80 


97 


81 


b 


29 


85 


47 


93 


70 


65 


31 


93 


79 


97 


82 


b 


35 


93 


70 


95 


88 


b 


39 


95 


77 


96 


84 


b 


42 


96 


66 


96 


88 


b 


42 


96 


64 


96 


86 


b 


42 


96 


66 


96 


88 


b 


42 


96 


64 


96 


86 


b 
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Table A2 (continued) 











Incumbent 


Benchmark Ratings 










vs . 


Team 1 






Incumbent 


Benchmark 


Benchmark 


vs . 






Ratings 


Ratings 


Ratings 


Team 2 


AFS a 


Title 


R n R kk 


Rll R kk 


r 


r * 



.341X7 
361X0 
362X2 



Missile Trainer Spec 39 93 59 92 

Cable & Antenna Sys Instal/Maint Spec 29 93 53 94 
Electronic Switching Systems Spec 35 94 76 96 



76 
81 
83 



b 

83 
b 



Note . Decimals have been omitted. 

a For the'purpose of this report, not all changes in AFSs as shown in AFR 39-1 since the beginning of 
this project are reflected in this chart. However, seven AFSs have been deleted from this table due to 
changes in career field necessitating their reassessment. 

* b Teatr. 1 and Team 2 analyses not conducted on these specialties. 
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Table A3. Specialties Used'in the Development and Application of the General/Administrative 

Benchmark Scales 



Incumbent 
vs. 



Benchmark Ratings 
Team 1 



AFS C 



Title 



Incumbent 


Benchmark 


Benchmark 


vs . 


Ratir 


igs . 


Rat ings 


Rat ings 


Team 


R ll 


R kk 






r 


r 


33 


94 


51 


93 


76 


54 


38 


98 


65 


96 


80 


75 


53 


97 


79 


98 


85 


89 


42 


97 


65 


96 


95 


79 


31 


94 


40 


89 


86 


b 


45 


97 


70 


97 


86 


83 


45 


97 


73 


97 


89 


82 


29 


95 


57 


94 


86 


b 


41 


98 


71 


97 


81 


81 


31 


93 


68 


96 


66 


82 


42 


98 


72 


97 


70 


79 


26 


94 


46 


91 


76 


66 


46 


97 


70 


97 


84 


75 


46 


97 


60 


95 


83 


66 


46 


97 


52 


93 


76 


53 


36 


96 


48 


92 


71 


b 


30 


92 


48 


92 


69 


68 


33 


95 


75 


97 


79 


85 


33 


92 


58 


94 


76 


58 


36 


97 


68 


96 


76 


75 


32 


93 


56 


94 


66 


71 


32 


93 


57 


94 


68 


59 


29 


93 


44 


90 


84 


57 


29 


89 


36 


87 


75 


36 


36 


95 


69 


96 


78 


78 


36 


95 


74 


97 


75 


84 


36 


95 


67 


96 


83 


82 


34 


96 


45 


91 


58 


52 


27 


89 


60 


95 


73 


67 


33 


89 


61 


95 


74 


79 



115X0 Pararescue/Recovery Spec 

204X0 Intelligence Operations Spec 

231X0 Audiovisual Media Spec 

231X1 Graphics Spec 

231X2 Still Photographic Spec 

233X0 Cont Photoprocess ing Spec 

233X1 Photoprocess ing Control Spec 

241X0 Safety Spec 

291X0 Telecommunications Operator 

293X3 Radio Operator 

295X0 Auto Digital Switching Spec 

392X0 Maintenance Management Spec 

511X0 Computer Operator 

511X1 Programming Spec 

511X2 Computer Systems/Analysis & Design Spec 

553X0 Site Development Spec 

554X0 Real Estate-Cost Mgt Analysis Spec 

555X0 Production Control Spec 

566X0 Entomology Spec 

571X0 Fire Protection Spec 

^91X4 Packaging Spec 

b02X0 Passenger & HHG Spec 

602X1 Freight Traffic Spec 

605X0 Air Passenger Spec 

611X0 Services Spec 

611X1 Meatcutter 

622X1 Diet Therapy Spec 

631X0 Fuel Spec 

645X0 Inventory Mgt Spec 

645X1 Material Facilities Spec 
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Table A3 (continued) 



AFS a 



Incumbent 
Ratings 



Benchmark 
Ratings 



Title 



Incumbent 
vs. 
Benchmark 
Ratings 



Benchmark Ratings 
Team 1 
vs. 
Team 2 



R ll R kk R ll R kk 



to 
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645X2 


Supply Systems Spec 


33 


90 


62 


95 


74 


64 


651X0 


Contracting Spec 


33 


97 


62 


95 


88 


79 


672X0 


Budget Spec 


36 


94 


58 


94 


83 


70 


672X1 


General Accounting Spec 


36 


94 


43 


90 


77 


48 


672X2 


Disbursement Accounting Spec 


36 


94 


52 


94 


80 


74 


691X0 


Management Analysis Spec 


42 


97 


67 


96 


84 


b 


701X0 


Chapel Management Spec 


46 


98 


67 


96 


77 


87 


705X0 


Legal Services Spec 


45 


98 


69 


98 


86 


80 


713X0 


Printing Binding Spec 


41 


97 


64 


96 


76 


81 


713X1 


Photolithography Spec 


41 


97 


61 


95 


54 


72 


713X2 


Duplicating Spec 


41 


97 


58 


94 


83 


76 


732X0 


Personnel Spec 


27 


94 


58 


94 


67 


60 


732X1 


Personal Affairs Spec 


28 


95 


60 


95 


86 


76 


733X1 


Manpower Management Spec 


41 


96 


47 


92 


75 


b 


741X1 


Recreation Services Spec 


32 


93 


79 


98 


89 


91 


742X0 


Club Management Spec 


34 


96 


73 


97 


86 


83 


751X2 


Training Spec 


40 


97 


69 


96 


83 


76 


753X0 


Small Arms Spec 


28 


91 


66 


96 


78 


84 


791X0 


Information Spec 


34 


95 


67 


96 


89 


b 


791X1 


Radio & TV Broadcasting Spec 


34 


95 


71 


97 


83 


b 


811X0 


Security Spec 


25 


96 


52 


93 


80 


b 


811X2 


Law Enforcement Spec 


25 


96 


55 


94 


81 


b 


901X0 


Aeromedical Spec 


40 


94 


69 


96 


60 


84 


902X0 


Medical Service Spec 


41 


97 


60 


95 


85 


b 


902X2 


Operating Room Spec 


46 


96 


71 


97 


76 


81 


903X0 


Radiologic Spec 


42 


97 


68 


96 


76 


86 


904X0 


Medical Laboratory "Spec 


34 


93 


55 


94 


70 


77 


905X0 


Pharmacy Spec V 


44 


98 


57 


94 


81 


76 


906X0 


Medical Admin is trative~Spe^c 


43 


97 


93 


95 


75 


b 


907X0 


Environmental Health Spec ) 


32 


95 


64 


96 


81 


71 



34 



33 



Table A3 (continued) 



AFS a 



Title 



908X0 Veterinary 

911X0 Aerosp Physiology Spec 

914X0 Mental Health Clinic 

914X1 Mental Health Unit Spec 

921X0 Survival Training Spec 

922X0 Aircrew Life Support Spec 

981X0 Dental Spec 

981X1 Preventive Dentistry Spec 

982X0 Dental Laboratory Spec 



Incumbent Benchmark 
Ratings Ratings 



Rll Rkk R ll R kk 



Incumbent 
vs. 
Benchmark 
Rat in g 8 



Benchmark Ratings 
Team 1 

f 

V8. 

Team 2 



30 


94 


54 


93 


84 


35 


97 


52 


93 


76 


43 


96 


74 


97 


90 


43 


96 


74 


97 


90 


43 


97 


59 


94 


79 


33 


96 


50 


92 


86 


31 


93 


67 


96 


75 


31 


93 


67 


96 


70 


43 


98 


47 


91 


84 



68 

74 

83 

86 

b 

b 

74 
71 
b 



to 
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Note. Decimals have been omitted. 

changes in career field necessitating their reassessment. 

"Team 1 and Team 2 analyses not conducted on these specialties. 
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■im:U)IX H: MECHANICAL. GENERAL. AND ELECTRONICS 
BENCHMARK SCALES 



t 
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MECHANICAL BENCHMARK SCALE 



LEVEL I 

POLICE GROUNDS FOR LITTER 
POLICE OPEN STORAGE AREAS 

LEVEL 2 
CUT WEEDS 
DISPOSE OF RAGS 

LEVEL 3 

LUBRICATE CABLES 
RAKE BAR SCREENS 

LEVEL 4 

LUBRICATE HAND TOOLS 

STENCIL DATE OF INSPECTION ON LIFE RAFTS 

LEVEL 5 

CLEAN LIFE PRESERVERS 
DIC DITCHES BY HAND 

LEVEL 6 

clean paint equipment sicii as brushes or 

ROLLERS 

APPLY REFLECT!! E TAPE TO EQUIPMENT 
LEVEL 7 

REMOVE OR REPLACE VENETIAN BLINDS 
('LEAN EQUIPMENT OR AREAS AFTER APPLYING 
PROTECTIVE COATINGS 

LEVEL 8 

M UNTAIN TOOL CRIBS 
MIX CONCRF'F in HAND 

LEVEL 9 

POSITION NONPOWERED GROUND EQUIPMENT 

AROUND AIRCRAFT 
APPLY ENAMELS TO SURFACES USING ROLLERS 

LEVEL 10 

CLEAN AND REGRAP SPARK PLUGS 

CAl LK AREAS AROUND WINDOWS, SINK, OR BATHTUBS 

LEVEL II 

PERFORM OPERATOR INSPECTIONS OR MAINTENANCE 

ON DUMP TRUCKS 
DRAIN ENGINE OIL SYSTEMS 

LEVEL 12 

REMOVE OR REPLACE NOZZLES OR HOSES ON MOTOR 

CASLINE UNITS 
PREPARE ENAMELS FOR APPLICATION 

LEVEL 13 

INSTALL OR REPLACE WATER FOUNTAINS 
DISASSEMBLE OR CLEAN CONVENTIONAL FUEL GATE 
VALVES 



LEVEL U 

PRIME COMPONENTS SUCH AS STARTERS \NI> 

HYDRAULIC PUMPS 
DISASSEMBLE OR CLEAN CONVENTIONAL FUEL 

LUBRICATED PLUG VALVES 

LEVEL 15 

PERFORM PREOPERATIONAL INSPECTIONS OF ENGINE 
AFTER ENGINE HAS BEEN ON LONG STANDBY 

INSTALL OR REPLACE FORMICA ON COUNTER TOPS OR 
SPLASH BO\RDS 

LEVEL 16 

REMOVE OR INSTALL CANOPY HOSES OR TUBING 
PRIME AND BLEED FUEL SYSTEMS 

LEVEL 17 

REMOVE OR REPLACE TRANSMISSION-DIM! EN 
GENERATORS 

ADJUST AUTOMATIC GOVERNORS AND VOLTAGE 
REGULATORS 

LEVEL 18 

TROUBLESIIOOT HIGH OR LUBE OIL PRESSURE 
INSTALL FUEL MANIFOLDS AND FUEL NOZZLES 

LEVEL 19 

INSTALL ELECTRICAL COMPONENTS 
REMOVE OR INSTALL FUEL CELLS 

IKVFI ?0 

READ AND INTERPRET SCHEMATIC OR WIRING 
DIAGRAMS 

INSTALL TAIL ROTOR ASSEMBLIES ON IIELICOP1 EH 
AIRCRAFT 

LEVEL 21 

REMOVE OR INST MX TAIL DRIVE ASSEMBLE 
DIRECT AIRCRAFT EXPLOSIVE HAZARD PENDER SAFE 
PROCEDURES 

LEVEL 22 

PERFORM CRITICAL MEASUREMENTS ON JET ENGINES 
ADJUST CANOPIES 

LEVEL 23 

REMOVE OH REPLACE CYCLIC CONTROL SYSTEM 

COMPONENTS 
REMOVE OR INSTALL MAIN ROTOR TRANSMISSION 

LEVEL 24 

TROUBLESIIOOT FULLY ARTICULATED ROTOR SYSEMS 

AND DETERMINE CORRECTIVE ACTIONS 
ASSEMBLE MAIN ENGINE SECTIONS 

LEVEL 25 

TROUBLESIIOOT SYSTEMS FOR BREAKER TRIP-OUTS 
TROUBLESIIOOT INSTALLED ENGINES 
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GENERAL/ADMINISTRATIVE BENCHMARK SCALE 



LEVEL I 

(LEW OK U \s|| M | LIT \ 10 XEHH LE> 
STU'LE lU BLH VTloNs* OK REPORTS 

LEX EL 2 

PREP \HE 10ENTIFK VTION li\Mhl()|{ I' VTlENTs 
OPKK XTK FXULTH L<MJv.snR IMMlRs 

LEX EL 3 

LOLLVTh PI ULK \TIO\s 
MTLX t.OLD (OMPRExsF.s 

LEX EL t 

prepxki: neu si»\i»eb or other imiintfii 

M VIERIM.s lOlt \I\ILIV. 
s*NN< IL IDENTIFR XTION M MHERs ON I 11 E 
si PPORT EQl IPMEVT 

LEX EL 5 

T\KE OK KE< OKI) ItXIPKKXTI REs 
SHIR* VH M»ONs|N VM\PO\s sTOR\(,t 
KM KHt 

LEX EL 6 

INsTXLLOK HEMOU s|V,lt-\|sOK 
\s.sFMBLIEs ON lit I METs 

\n\isE iNDixim m.soi mi nt mutts 
\ noer ink i htm vmfndmfnt 

LEX EL 7 

PKEPMtt KK^I Es'|s|oR MH»K \l/lifVI M 
RF.LORDs OR IN| ( >KM M ION FOR Ms 

I'HOS IDF (.1 IDSV | TO INsi'M | \TI0N 
MMIORs 

LEX EL 8 

PKEPXKKoK M Mi MEOW M INI OHM \TION TO 
KH,JI EMIV, \<»FN( IE> 

< IIXLLKV.t OK IDI NTH X I NKNOUN |»| Rsn\s 

LEX EL <> 

minim n ioi lis nnton. H | S< IIIIIKs 
rSKE OK RECORD It SOI M PI \M 

LEX EL SO 

INsPHT sin. OK I \< II Mil s H>lt s| 1PPIV. 
II\/\KDs 

M MUX LVsMFIED MMKItIM M V < 101 N | 
OK |N( IDF NT s< FN E> 

LEX El. II 

TXkE OK KE<-OR|l \VU \\ PI |>| 
!Ns|»K<TOW.EN M \>k> OR \CUssoKI|s 

LEX EL 12 

< OOHOIN \TE < OMl'l ETION OF ( I INK M 

KEf.ORIls UITM NI>MM\NsOK M RMV. 
VI UFs 

(ONTIIOI FNTKX SNDIKMIK MDIMMFK 
s( I- NKs 

LEX EL LI 

IVsTKILT sTl IIFNTs IN METHODS <>h 
PROTE<TlV, KM>D> FKOM ENXIRONXiFNT 
- OK \NIXI\Ls 
sKLE(T KILTER*) Foil PENhTK VI IV, II S/F 



LEVEL 1 1 

lilt IFF PERSONNEL I'lUOH TO M'PLXRXM F ON 

K WHO OR TX 
NssEMIiLK sj KMX \L KITs KHt s|»i;< tKI« 

MLsMOVs 



LEX EL 15 

MMNTMN I1W \1\sFHt PI \Ns 
< OXIPt TE \IR ( ItFU \\ \|| Mill m 

LEX EL 16 

E> r XBXL|s|| KM M'lON OF FAIsTIV. 

lOlMM.KVPHK M II Ml Kl s 
M\Nl MM PROcT>MO|OK RIXlRsXI I'll M 



LEX EL 17 x 
< ONDl (T IVTEKX IFU s |N ( ()NN| (T ION UN II 

STOKX \>sk;nxifnis 
ItFXIKU sol K(E MM Kill M IO Dl II KM IN I 
POKTION.s Is Mil.! FOR PROJI,(Ts 

LEX EL 18 

DITFRMINK REOI IRFlM.RXDFs \N|) MR I oK< I 

>PF< IXI.TV < OllFs 
URIIT It MHO X ItlPIs 

LEX EL 10 

DlltK TOPER \ HON Ol MKOMFDK M I \ \< I \- 

TION | \< II ITIl s 
\N\M/| IT.NXNI UORMOVD DM V IO 
hi TERMING IIOs'l M\NPnU|R IMPMI 

LEX EL 20 

(.IIOsI UltlTF ElM'lORIXLs 
<ONDMTRi:ilMRs\|>0| | \ PIMM.K XX|s 

LEN EL 21 

Di l i RMINI. Kf NLII'ls DLKlM.D I ROM I \< II 
M ILRNMIM METHOD Ol \< < OMPLIMIIV. 
OHJKTIV Ls 

FN M I M h OR \ \| ID M l N| Ml FOR |NDI\ IDI M 
M SNKJU I R M (.Ml NT M'lON POslTIONs 

LEX EL 22 

111 II D I P I II I s( PIMjRT MOHILITX 

( ONTMNLRs 
NDXIINIMER PRIMMtX < Mtl M MINI <)| 

M I IDFNT.s 

LEX EL 2.t 

DIRECr It M>iO OR T| I I \lsION PROI.RMIs 
PK It FORM lit I V.K Dl RIN(. Dls\s|Flt 
MTl M ION.s 

LEX EL 24 

URITE .sTM l s FI DIES. >l RS FX s OR >PE< I VI 
REPORTS 

\DX|sF PKRSONNIJ ON ( IMI INN IO M i ll SND 
X1EDK M PKOf.K XXI OF Till- I Nil ORXIl D 
sERXK Es 

LEX EL 2.> 

PRFPXIU MXN\(.niFN'l \DMsOltX RI.I'ORI 
Dh>K,N INTERIOR I TILTH Us sXsTKMs 
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LEVEL I 

REMOVE \M> DISPOSE OF TRVSII. * ASTE OR 
M \TER1 VLi> 

Cl.KVNOH MMNTMN VRF.VS Ol TSIDE OF ShOP 
LEV EL 2 

CLEW OH V NCI I VI KOI IPMKNT 

POLISH OR U \\>:0l IPMENT OR EVC.IIJTIKS 

LEVEL 3 » 

CLE VN V\l> MAINTVIN II VM) TOOLS OR T(M)L 
BOXES 

MONITOR CLOSED CIRCl IT TELEVISION 
LEV EL t 

INSPECT VNDCLEVN KOI I. * ESTHER GEAR 
INFLATE OR DEKLVTE VEHICLE TIRES 

LEV EL 5 

sTENCIL. DFCVL. OR PVINT INSTRICTIONS 

OR IDENTIFIERS ON EOl IPMENT 
CI J \N OR LI BRICSTE MECH VNICVl. DEVICES 

sUII VsGEVltsOH HINGES 

LEV EL 6 

Cl KAN \NI) INsI'ECT I.K.irilV. FIVIT KKS 
PERFORM TOOI HON INVENTORIES 

LEV El. 7 

VIM VLI.V INSPECT BVT1 FRIES 
Kt VI) sERV K.F METERS 

LEVEL a 

PERFORM V|>1 VI INSPECTION O* RADOMEs 
CLE VN VND TIN SOLDERING EOl IPMKNT 

LEV EL <) 

VLSI VI.I.V INSPECT ELECTRIC. \l BONDS 

VNDC.ROI NDs 
INSTVLL VIOl NTINC RR \< KETs OR ElVTl RE> 

LEVEL 10 

INSTU.L CRIMPED UIRINC TERMINALS ON 
COMI»ONENTS. LINK REPLACE VHLK I NITS. 
OR VlODl LE UIRINC. 

INSPECT El MTRIC VL Ol TLKTS FOR CROl NDlNC 

LEV EL 1 1 

RKVIOV E OR IVsT \LL CELLS OR sTR VPS ON 
N|( KEL C.VDMH VI OR SILVER /INC 
R VTTKRIKS 

VIM M.LV IV'WT VURE HARNESSES. CABI.E>. 
OR CONNECTOR Pl.l C.S 

LEVEL 12 

sOLDF.R VI IRKS TO CONNECTOR FLICS. CON- 
TROL BONES. OK CONTROL PAN'EI^S 
VLSI ALL V INSPECT PKKSSl RE EARNING 

circ:i ITS 



LEVEL 13 

INSPECT OR OPERATIONALLY CHECK 
HVDRAl LIC PRESSl RE INDICATING 
SYSTEMS 

INSPECT UINDSPEED TRANSVHTTING OR 
MONITORING EQllPMENT 

LEVEL I * 

ADJIST TRANSVHSSOMETER PROJECTOR LAMP 
VOLTAGES 

REPLACE MECHANICAL COMPONENTS SUCH AS 
BEARINGS. GEARS. OR PULLEYS 



LEVEL IS 

INSPECT OR OPERATION VI.I.V CHECK SI RFVCE 
OR FLAP POSITION INDICATING SYSTEMS 

REMOV E OR REPLVCE SOCKETS FOR COMPONENTS 
SIOI VS TUILS. RELVVS. VM'»\ TRAN- 
SISTORS or intec;r vted circi its 

LEVEL 16 

VDJl ST VMPI.IFIEK HVI.VNC.ES 
PERFORM POYt ER CHECKS OF COMMUNICATIONS, 
SV STEMS INST VI.I.EI) ON VIHCKVFT 

LEVEL 17 

VI.IGN OR \DJlSTTR \NSMISSOV;ETER I NITs 
PERFORM HKill.V VLl E UNSOLDERING 

LEVEL 18 

VDJl ST OR ALIGN R VDVR HEIGHT INDICVTOR 
R VNGE M \RK GENERATING CIRCllTS 

TROl RLES»KM)T CONV ENTION VI.. NONA ER TIC M 
SCALE INSTRl MENT. Fl'KI. FLO* IN- 
DICVTINC M STEMS ON VIRCRVFT 

LEVEL 19 

VDJl .sT OR VLICN V IDEO AMPLIFIERS 
TROl BLEshvH)T VilM) MEVSl RING SETS 

LEVEL 20 

TROl BLEsH(K>T(ON>TVNT .sPEED DRIVE 
CIRCI ITs 

VLICN OR VDJl ST V'/IMITII VND EI.FV VTION 
VNCLE DETECTION CIRCI TTRV 

LEVEL 21 

TROl BLEMIOOf VIRCRVFT FLIC I IT (.ON TROl 
CIRCl ITS 

VDJl ST OR VLIGN ELECTRONIC (OlNTER 
COl NTERMEVsl REs ClRCIl ITS 

LEVEL 22 

TROl BLEMIOOT POU ER sl'PPLIES VND DlS- 

TRIIU TIONs ON DIGI TAL COMPl TERs 
PERFORM VLICN VIE NT OF VIRCRVH* ID RECEIVER 



LEVEL 23 

TROl BLESIIOOT REG I LVTOH ( IRCIITS ON 
DEV ICES Vt HK II I SE VN AN *LOC COMPl TEH 

PERFORM ALIGNMENTS OR ADJl sTMENTS Of AN/ 
Al'M-335 KVDAR RECEIVER TRVNSV1I1TER 
TEST SFTS 

LEVEL 21 

ISOLATE MALFUNCTIONS IN SYNCHRONIZER 
CIRCl Tl rIY 

PERFORM ALIGNMENTS OF ADJL STM EN'TS OF AN/ 
APM-336 RADAR VIDEO/SERVO TE-ST SET 



LEV EL 25 

PERFORM FAI LT ISOLATION OF WAPM.33G 

RADAR VIDEO SERVO TEST SET 
PERFORM ALIGNMENTS OR ADJl STVIENTS OF 

12A«X>8ll PENETR VTION All) TLST 

STATIONS 
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APPENDIX C: EXCERPTS FROM THE PROCEDURAL GUIDE FOR USE 
OF THE MECHANICAL BENCHMARK SCALE 
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PART I 

ASSESSING LEARNING DIFFICULTY AND 
RATING TASKS 



1.0 INTRODUCTION 



\ou are a member of a panel thai will a**i*t tin* I S\F Human Re-oune- Lahoralon b\ pro\idiug data oil the 
learning difficult)" of >clec led \ir Force U*L*. Thi> Guide dc\-c rihc\- the proi eihirc l)> wine h llioe la>k- arr lo be 
rated. Yon will: 

(1) Learn to n*c a specific rc*earch method in judging learning difficult). 

(2) Co lo place* where work i> being performed and Mud) the ta-k* in ihrir workplace. 

(3) Rale each -elected la>k u*ing a 25-level Benchmark Rating Scale. 

Tin* guide cun*i*t* of two |*arl>. Pari I explain.* how lo follow the required roean h procedure and how to use 
the specific definition of learning diffn ult\ /' Thai definition L*. "lime required to learn lo perform the la-k 
*att*facloril\ . 

2.0 PURPOSE OF DIFFICULTY RATINGS 

2.! Background 

Since PO the \ir Fori e Human Rc\-ourcc> Lilboralon ha> been developing a hank of scientific dala. 
eoncermng the \arion> kind* of work performed in the Air Fore-. V- a reMill, mo*l \ir Force Specialtie> ( \FS*) ran 
now he described b\ a h-t of *c\eral hundred .specific la>k> that are performed b\ personnel in that *peciallj. 
The*e h*t.* are in the form of la*k imetilories. and lhe\ were derived from -tine)- of worker- and MipeniMir*. 
Each listed la-k i> one which i> acluall) performed b\ personnel in the NFS. a> reported h) the surve). 

The la*k iinenlorie* un hide data about each la*k. mk h a> the frequciic) with whic h it i> performed, how 
main people perform it. and it- relative difficult). These data are used hoth in research and for main practical 
management decision*. Ta*k iinentoric- are u>ed in eloigning training, in determining career ladder-, and in 
setting inininnim *core* on the \riued Sen ice> Yoialional Aptitude Batten, a batten of lot* require<l for enln 
into *pecific career field.*. 

2.2 Difficult) Data 

/ In an earlier Min e\ NCO* in cac ii \ FS w ere asked lo pro\ ide la>k difficult) data. A> a reMill of their input, the 

la-k imenlorie* now include a cliffic nil) ralmg for ca< h task in the li*t. Thow ralings tell onl> how difficult each 
ta*k i* compared lo other la*k* in the -amc \FS. The) do nut tell how la.*L* in different \FS.* compare with each 
other. For in*tancc. UMiig tliim- ratings shere i> no wa) lo eompare the work of a medical teehnician wilh thai of a 
>eeurit) policeman. 

The procedure Oil* Guide de*i ribe* will he um-cl lo develop diffic ull) rating-, based on a common rating -rale, 
for Mr Force job.* with mechanical aptitude requirement.-. 

3.0 THE PANEL 

3.1 General 

L The panel of which \oii area member will rate *elec ted la-k- in each of *e\cral AFSs. These ta*k* do not co\er 
all work performed in the \FS concerned, but the) are a repre-enlali\c .-ample of the la*k inwmlor) for each \FS. 
The ratings the panel proude- will be u.*ed. following a statistical method, to vs hiate learning difficult) for all 



O 30 

ERIC 42 



tasks in (lie i mentor). Thus. (In- ratings jour panel nukes will set eliffie 1 1 1 1 > for all (asks in eae h APS. It i.« 4 i it re fore 
%er\ important dial (he ratings \ on nu l .c be performed wilh (arc, using ihi* e\atl tli-finilion and < rile ria llii** 
handbook tlrsi nlifs. Kat li rating \ou make, when a\eraged wilh other ratings, will detenuim tlu difficult) rating 
assigned to main otht r tasks. I'mal ratings wiJI he an important determine r of how johs and people art manage d in 
the Air Foree. 

/ 

3.2 Panel Training 

^ on will l><- required to stud) the prot edure and to uncle rlake at It ast two training exert ist s. Rt fun tlu pant I 
assembles, ea* h pain I member must read ami understand this part of this Ouidt . and stud \ the hem lunark tasks of 
Part II in detail. When tin* panel assembles, there will he a prattital exercise. Hie panel will he hru fed on 
procedures and all questions will he answered. Panel mem hers will tlu u ht givt u se\eral geuerall> familiar tasks. 
Flies will lia\e time to disc iiss those tasks and to ask quesliuiis. Then the) will rate the familiar tasks using the 
hem lunark Male. Panel memhers will compare their ratings for eat h task to determine how well the ratings art hi 
agreement. Panel memhers will he asked to explain win the> made eat li rating. The) will discuss how the) 
interpreted diffit nil) of the task, and how lhe\ interpreted the hemhmark stale, in order to t larif) an) 
misunderstanding of the method or of the benchmark scale; 

3.3 Materials 

The material* prowtled to )ou will imludt this (Juide. task list*, and rating sheets. The Task List slit els h«i\e 
spate for taking notes. It will he useful, howewr. to ha\e a pad of papt r for an) additional notes that ma) he 
required. 



kO RAT INC PROOF! >l RK 

kl General 

Kai h task is rated b\ (I) understanding how the task is performed. (2) anal)/iug liow diffit nil it is to learn. 
(3) comparing it to la*ks on the Rem lunark Rating S. ale. ant) ( l ) recording tlu difficult) lew I of the most 
eomparable tasks on the rating seale. 

k2 Task Assessment 

It tiMiall) will not he t lear. just from a task statement, what aii) gi\en task entails. Then fore, the panel will go 
to a tvpital t SAP workplate to stud) how eat h task is performed and what must bt h anted to perform it. Ideall). 
we would like to obsent the actual performance of c at h task. This is rareK prat lu al and would require repealed 
observations of eac h task to be meaningful. Therefore, the prim ip«n method of stud) will he to inler\ic w workc r?. 
Tlu- panel will visit workers in their actual workplace* in order to examine the eqtupim lit. tools, regulations, task 
orders, and other conditions' of the job. 

Tin- team should inn rview al least two holders of the APS studied. During the interv iew panelists should lake 
notes, hut lliej should not rale the tasks until Ller. Do nol hurry. Re sure all memhers of the panel full) 
understand eat h task before proteeeling to the next one. I nit rv it ws must ht held in a group, wilh all workers and 
paucd members participating. 

k3 Task Assessment Criteria 

Worker* should be interviewed to determine exactl) what eaih task is. how it is performed, and what A ills or 
knowledge? are required lo perform it adequately. Study I he following: 

(I) Task Definition. What is the task? FirM. clear up an) confusion about what the task slalemc lit means. We 
generally know what a task is when we know what materials the worker begins with and what the laA e ml prod m t 
is like. Whal are the boundaries of the task? Find out whal is and is nol included in task performance. This is a 
common area of confusion. If the lask is changing spark plugs, must othc r component (air filler, comprc ^Mir) be 
removed first? Or is this a separate task? t 
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(2) The number of sleps in a task Tasks ihal ha\e man) different steps are obviously more difficult lo learn 
(han those which have only a few sleps. Tasks Mul eoiiiain man) repetitions of ihe oame slep, however, ma) he 
relatively easy lo learn. 

(3) Tools and equipment unujuvU) ihe lask. The learning lime required for look and equipment unique lo a 
(ask adds lo learning difficult). 

U) Regulations manuals and .standard operating procedures How detailed is the doc umeiilalion? The more 
detailed it is, the le» has lo he harncd. Some tasks do not have lo be learned, because ihev can be performed by 
simply following written instructions. 

(5) Memorization. Dues the lask or an) portion of the lask have lo be memorized in order lo be performed' 
This adds lo learning difficulty. 

(6) Standards of Performance: Tasks differ in *hal level of qnalil) or realiabilil) is required for 
satisfactory perforniam e/" Fur example, packing a parachnle requires a higher slandard of product reliabilil) 

(han Joes changing a fancel washer. In ihe latter case, if the faneel leaks, )ou can do it again. 

(7) Time Crilicalilv: A lask ihal iiuisl be performed wilhiu a lime limit is more difficult lo h-aru ihau the 
same task wilh no limit for performance. 

(8) For many career fields there are required basic skilL or knowledge (typing, mathematics). In some cases 
ihese are laughl in the ISAF Technical School. These skills and knowledges add lo the learning difficult) of 
individual tasks only lo the exleiil ihal |he> are used in the performance of ihal lask. 

Finall), keep in mind during your as*essineul ihal )uii are judging "learning difficult)" — the lime required 
to learn lo perform the job satisfactorily . It includes onl) ihe learning lime niiiqiie lo the lask being rated 

4.1 Rating the Tasks 

After having studied the lask, ea< h panel member should be confident thai he understands the task, ideall) lo 
the pouilal which he«oiild perform il himself. He must know the starting point, the conditions of performance, the 
lask sleps, and the cnlrria for a salisfaclor) task product. He should have a sel of notes from which he can recall the 
lask and remember what skills or knowledge are required in ils performance. 

Then each panel member will be given lime lo make an assessment of difficult), in private, using the 
Benchmark Haling Scale. 

4.4.1 Isolate Learning Time. Panel members niiisl (arcfully *oiisider ea< h lask and determine how difficult il U lo 
learn. This means that the) niiisl recognize the difference between how hard the lask is lo perfotm and how hard il 
is lo learn. Only learning lime should he considered as part of lask difficulty Do not include learning lime 
associated with the basic skills and knowledge personnel should have for entry into the Air Force. 

1.2.2 Task Ratings. Kadi lask lo be rated niiisl now be compared with ihe tasks on the hem hiuark scale. Then, for 
each lask lo be rated, find a difficulty level on the benchmark scale which mosl closely corresponds to the 
difficulty level of the lask lo be raled. Verify this selection by reviewing those tasks on the benchmark scale which 
an- al the levels above and below your selection, ensuring thai the lasks above are more difficult lo learn and those 
below are less difficult lo learn. Record your rating. 

(1) Remember lo consider each task in lerms of learning difficulty —not how hard il is lo perform 

(2) If one oi the lasks at a level appears not lo be helpful, consider only the oilier lask al thai difficulty level. 

(3) If \ou disagree with the rating of both lasks al any level, use lasks above and below ihal level for 
comparison. 
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4.4,3 Reassess. E>peeiall\ during \our first few da\s using ibis procedure. \ou will make judgment thai >ou will 
want to reconsider later. This is bet au»e >ou are in llie process of learning how lo use ihe procedure, and because it 
lako tunc lo become familiar Willi the rating stale. Most important of all. \ou will learn a groat deal about bow lo 
observe and analyse work. 

Therefore, panel member* are encouraged lo reasses* ibeir rating* periodical!) and are required lo rerale 
ihose tasks aboul wbicb lliey form a new opinion. 
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DETAILED DESCRIPTIONS OF BENCHMARK SCALE TASKS 3 

■ 9 

M 

Level I: POLICE GROUNDS FOR ' ITI ER (Construction Equipment Operator - AFSC 55151) 

Task Performame. This task is llie routine policing of grouids around a hcav) equipment (umpuiind or around 
Iroop quarter*. On direction of a supervisor, liller is picked up b) ha K and disposed of in «aus or in a dmnpster 

Skill/Knowledge Required. No skill or knowledge is required wliiili must be learned in llie amice. The work i- 
performed using basic skills, learned early in life by everyone. 

M 9-1 

Level 9: POSITION NON-POWERED GROUND EQUIPMENT AROUND AIROUFT (Aircrew Egress Sjm-iiis. 
Repairman - AFSC 42352) 

Equipment: Non-powered ground eqiiipmeiil includes work stands, boisls, slings. >ejl dollies, tauop) stands or 
dollies, and fire exliriguisbers. Most liave wheel locks. Mosl work stands have baud rails which are installed a 1 the 
lime lliey arc positioned. Some stands include hydraulic lifls for raising and lowering the sland- 

Task Performance. Positioning of lliis equipiueiil is typically pari of another task. T.O. procedures normally -pell 
oul llie location of ibis equipment. Safel) is a l)ig factor to avoid danger lo personnel and damage to llie ain raft 
during positioning. Positioning im hides a visual inspection of the area prior to use. locating the equipment, 
moving il in, locking wheels, installing baud rails, and operating hjdraiilic baud pumps. 

Skill/Knowledge Required. The repairman must hav»- knowledge of *\u h nf the types of equipment used and of 
how lliey are positioned around ainrafl. Operation of the equipment is reasonably simple. The most important 
facloro are llie safely of personnel, and the prevention of damage to airerafl. 



M 18-2 

Level 18: INSTALL FUEL MANIFOLDS AND FUEL MOZZLES (Jel Engine Mechanic - AFSC 12652) 

Equipment: Fuel manifolds and nozzles are used lo distribute and injecl fuel into jet engines (1) \u e xternal 
manifold c-oiimsIs of sections of flexible and solid liibing. whic h are cornice led to fjrm a complex >oke around llie 
engine. Il conducts fuel lo lOor 12 nozzles, which are screwed into the bod) of the engine and which inject the fuel 
inlo the combustion chamber. (2) An internal manifold consists of a soft metal circular tube, with 8 nozzle 
cluslers, each containing 6 screw-in nozzles made of similar soft metal. The manifold is mounted around the 
inlcrior of the engine on brackets and support clamps. 

Both lypcs of manifold are very sensitive lo physical damage, being either fragile or easily denied and 
deformed. They are installed by bolls which must be either lab-locked or safely wired in position. 

Task Performance: The lask is performed with llie engine removed and placed on a stand. (1) External mai-ifold< 
are removed by disconnecting llie nozzles and removing manifold bracket bolls, afler which the circular manifold 
ih cither (a) carefully slid off the end of llie engine, or (b) removed by disconnecting •lie fillings between sections 
The nozzles are ibcn screwed out of llie engine bod). To install manifold and nozzles, llie procedure is reversed, 
nozzles and mounting bolls are lorqued and safel) wired. Extreme care must be taken lo avoid dents or bends m 

a Due toihe lengih of lhis section in the Procedural Guide, excerpl* only are provided. When u>cd in rating lasU eat h benchmark scale 
lask will appear on a scparale page and j,hould not exceed one page in Ifengtli. 
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manifold lines. Anli-sei/.e compound is required on nozzle threads. (2) To remove internal manifolds, main engine 
sections must he remo\cd logain access lo the combustion c hamhcr. Tlicn a special jig is inserted to prevent stress 
or de forma I ion of the manifold during nozzle removal. The 18 nozzles are removed and llie manifold is removed 
h) removing J sets eai h of mounting bracket bolls and support hratkel bolls. Aflcr removal, llie manifold is placed 
in another spec tal jig lo relieve an) stresses on the tubing. Installation is llie reverse of this procedure. Each nozzle 
is reinstalled by assembling 3 parts in the proper order, using the special jig. 

In either c ase, ihis task must he performed bv following the T.O. procedures lo the letter. These procedures 
are detailed, with illustrations. 

Skt I l/K nou ledge Required. This lask requires clelicalc skill, in order nol lo damage the manifolds. The task is 
c ritual because improper installation of the nozzles tan * aiise destruction of *in engine. The learning required lo 
perform this task iml.ides learning the general" engine structure, the tool and jig skills and the ifislallalion 
procedure, all f these to a higher level of precision and assurance Jmii would be required lo install a less fragile 
assemhl). 

M 25-2 

Level 25: TKOIBLESHOOT INSTALLED ENGINES (Jet Engine Mechanic - AFSC 42652) 

Equipment. This lask is performed on jet engines installed on aircrafl. Troubleshooting im hides isolation of 
fail in* within ihr engine or confirming thai a failure is nol in the engine but some related subsystem 

Task Performatue. TrouJih>hoolhig I) pic all) begins with a pilot write-up. Interpretation of these write-ups is 
often difficult. The isolation process depends upon the failure s)iuplom observed. Oil leaks, which are llie most 
torn moil problems require that all oil be cleaned from llie exterior of llie engine, the engine and oil s) stems 
exercised, and examining for the sounc of oil leaks. Vibralicns are isolated b) attaching vibration sensors at 
different locations around the engine and then running the engine lo look for abnormal vibration sources. Oilier 
problem.-* sut li as fuel leaks, throttle rigging, fuel control, and electrical problems require coordination with other 
subsystem specialties lo isolate the problem between llie engine and related S) stems. 

Shill/hnouUdge Requited. Learning troubleshooting i> a< coinplished hv exposure and is not formalized. Il 
requires: 

(a) A complete knowledge of engine operation and its interface with related aircraft subs)slem>. 

(b) Vlnlitv lo use and understand the readings of pressure gauges, vibration seniors, and heal gauges. 

(c) That the mechanic be cockpit qualified lo enable him to run up the engine, 
(cl) An ability lo read and interpret the appropriate Technical Orders. 

(e) Coordination with the c-fforls of other siihsVsteni specialists lo isolate problems in the interaction of the 
engine and related aircraft systems. 




